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PROBLEM TO BE SOLVED: To provide a general knowledge 
discovering system for efficiently realizing knowledge discovery by 
selectively sampling only data whose information quantity is large 
from a data base. 

SOLUTION: A learning means 104 allows a low rank learning 
algorithm inputted through an input part 1 07 to learn plural partial 
samples prepared by sampling from data stored in a high speed main 
memory 1 20, and obtains plural hypotheses. A data selecting means 

105 estimates the information quality of each candidate data read 
from a large capacity data storing device 1 30 by using the 
hypotheses, and additionally stores only the data whose information 
quantity is large in the high speed main memory 120. A control part 

106 repeats the processing prescribed number of times, and stores 
the obtained final hypothesis. Then, a predicting part 102 predicts a 
label value by the final hypothesis for data inputted to the input part 

107 whose label is unknown, and an output part 101 outputs this 
predicted value. 
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[#«f»#©ssh] 

^UX\k^|l|$x-*<hLTA£LT^B$i+, «&© 
&f&£f#-5#lf?a<>:, 

fiM*©mwe*«u «««©** wRita* 1 o 

ft3W4«»3BRU HIB/'f >^ ; EU(cig)taLTl&^ 
* <fc tfftBBH ©MS * * fe^fe fc#ik&fr tfft 

EA^lcA^Lfc5^;i/*a©x-^t;:*rLT5^;U 

fi^atr ^a^at, 

2*-f SH»M©^aiS:fT^. #«>fc^fi!l«©#1&<U::«J: 
0ME«tl£©*«*Sii£U H«»jft 

3EFSC. 

M*m3] BEx-*«*^fttt, WB*B^KC 

j: o ft ett&aftttoiWBwwT*-* K*ra"s*awnt 

©H8c£:LT&{KB©S*S:f|-gU x-*jiiR©f& 

£{I^ai|©l§£. S-^li^C^LT^iHtt**** 
ME<Rift©a*©Bft£J?ajU at>*#^£2).©BSi 
t \Z A # ^ «*-©i&gfq ©M#T * V- V > £ . 

»sw4, si»ffi^aj©«£. BEfiKicfc-aTBit© 

S*tt*#tt«©*£^«ttj££ l^*fctt«»a#ll, 
TfflB;W 'J CiilB LTfcfflU 
ME^ai^ate. ilBfil5i©S*C«tSS*.#|?jp^S 

31 1 KB«©tt«58ft*SC. 
W*W4] MBx-^iitR^att, mlBASSx- 

l^©K©7^;l/SrfUfflUT> ^M^ai)©if^, b5B<S 
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- s? >©/h $ frig* £ Sldifc tttt&iiiR L, ft 5 v» 

14. msffi^aii©*^, mrE^amws^tts^BKii 

t u \zmm lt»*w* c t t4»«tr««i*jn i ice 
m©aw^m^ic. 

>j ©ima?-? *» s MMtr* c «t tr aw** i 

KSffl^THftBO^aitt***. £ffi^aj©i§£. ffi 

*?u ^&<B^aQ©if&» HdE^a5ffl©a*ft#^ffl 
i 3 \zmk<»mmfU3*.. 

[»*«7] BBx-^BH^att. BBft«iA«a 
«LWE^-f>^ ; EUC*lfrr*t#. iElCiiuEpW> 

sa«u *»ffl^B©«&. ateTM«em»tt*? 

M££©/h;*t>8t|j&* l ^*;fc«t8SaiRU USE* 

Jfl R$i3 1 *fctt4 CB«©ttM561^SC. 

[B*«8] ^M^-^ftWSRlcttttSnfcx- 

©aiafgM^iSicfc^T, 
5x-^?rA*-ri.A^^ai:. 

40 K¥s*ac*0»sftfca*©«»©fiRSffli,>T, 

WE***x-^*lft»B*6tt*HiSti&*»:©l»-> 
K:«"^*«t*|j«©tiMRa*jBeL. if^fi©A#i/^ffi 

.«*ffi&a^L, siiE^-r>^ ; euici&srt-r?)7 : -^a 
^#a<t. 

WB^B^atiiEx-^aiR^afc^ttix-^feiW 
5ST«oMt. ^©^*?#enfc«»©fitift*s«ng 

Ittt LTbTJE^'T U t> L < (4A^ffi7 ; -^^g 
50 g!C^iW$1±5SlltJ?a<!:. 
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SWT* C £ *»at-r*tt«56s.*a. 

[W*«9] MEx-^aRWi, ffiE^B^ftfc 

9ttfiftttAalfHM*Jt«U »«fflo*S^«»^ 
* - SftRfT 8 KBR<&»R5B jllfrjC. 70 

w*aioi MEx-^aK^aa, me^b^r 
fcio^snfcftfiKowEwwx-^Ks-r^TaiK 

MEfiKoa*©iB»^jmjL, »t>*#^i[^ttfii 

**W4, ^RM^ajG)*^ METRIC £*?Mt0 

WE^aj^RfcJ:. i^KR0a*£J;*a*f't£¥^£ 
«8KE*©ftR*JIJ*3t. 

w*. tCfE^ans^a^^^auR 
u tcfttt-r * c: t 8 ke«<z>si 

>yLTfP*bfc*ft©»»7 f -^»^*»E*S7* 40 
^UXAA.jim^-^tuxAAUT^H**, *t&<0 

&R«ft*¥B¥K£, 

WE*«7 f ^^*lft»R^6R*lil*nfcaR©'»-> 
^HKtt^JcWTSBIftttO^ailSrfifV^ sRfcfc^ajtt 

WE^B^atflttEx-^aR^aicfewsx-^tttt 
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SSTRDSU ^<0«rjK»en^«ftOiKR«a«fi 
R t L T ffiE * > * ^ U *> L < x- * teJrtS 

EAAa^A^Lfc^^^ttOx-^tC^LT^^ 

M*«13] WEx-^a*i¥Rtt, ME¥B¥R 
•CJ:0#6*lfc«RofcR*«^TaElf>^JHiaA 

»c»T*H»«(o^a!i*fftv ^Afc^aiao^aaK: 

jft*l^»*^fi«»atRL, HBjW >**UlCfc« 

So 

[tt$« 1 4 ] 8aEx-^a«¥Rtt, • flUE¥B*R 

Kijioft&nfeftRR^nEMa^-^icMrerm 

ffiEfiR©fi*(Dtt»£»aju 
^©v-s;>©/h4nanjft* i^*fctt«»a«L, 

R©a*.jcj:^a^(*#^*feoTa»fiRtcj;^^ 

«*ff 3 C ££»»£TaR#H 1 2 icB&OftlKRji, 

«ffij£©K(07^;U&fiJfflLT, ^tt^aj©*^* I9E 
RR^TRRHtW^TfHIv-y^tJItJHL, KsgH 

ranoffaiftRn] 

[0 0 0 1] 

■aJWrSCfcRT*. 

[0 0 0 2] 

*^<^aft7^-bXL, R*&0£<!:K:J:9*»fc 



5 

roceedings of ACM SIGMOD Conference on Management 
of data)] 2 0 7g— 2 1 6 HfcE*<B7^ 5 7;KAgg 
rawal) r-?"fx>^ 7VyX-y 3 > 

7 — x -r—^^—irX (Mining Association Rules 
Between Sets of Items in Large Databases)] KSMffl 

[0 0 0 3] Sfc, TjXZttjLZtlitT-jrtomiR 
«it>7U >^?)^<hLTte, *HKH¥B£Pftftt 

stttso. 1 9 9 2^wu<^m^m<D^ 

fiS* ryni/-x^ *:/ if 707 7- 

a7A 7^y3 7^ 3>fcf 

af-yatil/ y — ~>tf ir^U — (Proceed ingsof 
the fifth annual ACM workshop on computational le 
arning thoery)j 2 8 7H— 2 9 4 MtClB^CDir >^(S 
eung) £><Z)f&;£ r^xU— A< -/5V (Query by C 
ommittee)j KfiMBI#E*S snr^S. 

[0 0 0 4] ttfl6©Jt««fi(r^S*SC<0»»** 
B**T»6*lfc*»©«EKftilE^r*Ci:fc:J:0*H 

tt, i 9 9 4*«ff©*U7*;i/x7*:*;t-iri/-tt 

<B8tiK«ft»4 2 1 tC|B«Snfe^7-f vXBreiBan) 
CO^X r;ty*>y ^UtV #*-X(Bagging Predi 
ctors) J KE*3*1TH*. 
[0 0 0 5] y-xf>f>^fSi;^m 199 

if -fe*>H 3-nt!7> n>y 7 l/>X 
^/ear-yatJl/ -fe * U — (Proce 

edings of the second european conference on comput 
ational learning thoery) J 2 3 H- 3 7 HlCl2l£tf)7 
n-f > F(Freund)<hv<\- £ U (Snap i re) <DHi T7 x 

*y *>7-f> 5-X># 7>H 7>77°U^r 
"'>3> — Xf-f >^(A decision-theore 
tic generalization of on-line learning and an appl 
ication to boosting)] KEttSflTH*. ±E©ftffl 

■H*a36ratt, r*xh»a«fl)»si:j3^T, a^ 
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[0 0 0 6] 

[0007] ^oawra, ±Eoja^«*T&snfct> 

[0 0 0 8] 

UXA*J:tXR*B7^^UXAfc¥S^"a:*x-^^ 

A*-rsA*^at. WE^o^tu'fcjMnsnT^ 

^«&*WB*B7JU^UXA'\fl|«[x-^tUTAA 

afc<to#6nfc*»o)fi»i€:ffl^TH9E*sax-^ 

«Sc»«U WE^<>^ : E:UlCiiJjoLT»Jfl-r-5x- 

^aR^at, ME^B^atflttEx-^a^atct 

[0 0 0 9] i*S2HlBi(Oi^ii, W*jsuce« 
^^a^ c fcot#e>nfe«^^^^ffl^THfriBit>y 



(5) 
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MB^-*a«W*, MB*B¥ftlCJ:0*&*ifc# 
ftMjftlcMLT?flilt«3K«b«ttBfiKoa»0!) 

i»E{KRfc«k*THtt<BM*ft##««© 
*#MMijflt* i o*fctt«»aRUTWB^-f 

[0 0 10] »#«4£E*<0»9ltt, fit*S 1 IcEfc 
©tt«38***K:*^T» mfEx-^ilJR^att, ME 

MElKitt©^a!lS^S:ffl^T»«V->?>Sr|)[tli 
*. B*«5JcE«<Z)»Wtt, B*llSfctt2l:St 

©»«38a*a:K:*^T, ME^-^aa^ara:, aoe 
R«jS&a«UB9E^-f >^^ijic*ttr*t#, wc 

Bft*®fiR£m>THftBa7Ntf*£tt. ttB?H 

[0 0 11] R*fl6lcBR®9Mll»U »3R«l*fctt 
3lcER©ttRJB*#aK:;&^T\ WBt 5 - 

WE«*ija*aRLWB^-f >**u 
gE^suE^-r>^ : tufc^$nT^s^-^ic*f 

tRU mE^O^^UWftWx-^J&^BJI^-rSili: 
£#ffc£T3o R*K7KE««>IMItt, fflEx-*S 
R^att, l»#aiSfctt4k:E«Oft»56**aic45 ^ 
HT, WE«llja*a«LME^-f >^ ; EUk:*lrt1--5 
BEKbuEpW UlCfMflSnT^*^-*!;: 
J*tT, fflE«»(7)fiMS:ffl^TII»tl<DTflHt** 

^emma*^ WET«««>«jiv-5;>fl!)*e 
H^ja*iosfctt*»a#iu m&m^moms. 

[0 0 12] M*a8£B«0ft9!tt, 



W2 0 0 1 -2 2 9 0 2 6 
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mr*5 f -^T-f=:>yottW8ji*afc*^T, *b 

-*£A2rr*Art*a£. WE^-f ^/^UlcftttS 

*<frraiwa£, **B^ak:«ko»6hfca5fe© 
* nfcBBo* > %m&me>?m 

U B«B©**^«»jft**fta*?L; 89E*-f>* 
tU^Mt^r-^I^i, mE^B^a^lltE 

©e*#5nfctt»©fiKs»inERtLTsaE^-f> 
^ : Eijt»L<tt*«?-?*«iii:i(ma«i!ii 
^at. saE«»tofi[ijiffl<o¥^sfctta*ft^^$ 

[0 0 13] tt$3 9£BR0»91tt, tt$B8£BR 
<0»R58S^iCk:*^T, jfflEx-^RK^att. WE 
^B^a»cJ:0»^nfc«»©<KK*ffl^T«»Elt>^ 

£MKBlcJ:DME1ittljft0!)1lim«lt£t, 
«^ftttA«l^ft«^BBKHRL^ mfE*<>** 
UkHMft1-«ct*1»«tr*. K#«l OJCB«<036 
W4, M«8 CBtoa»!**a;i:i^T, IKEf 
-*R«¥Rtt. ME«¥RKJ:D»&ftfcftteR0 
WERWx-^^Tft^MRJStORBiiLTftlKRO 

Rlfjtt^MLT'FHB^^ttdttEfiRoa^Rnt 
SfflU at>*#^B*©R«ii2fcc*#^B*a)Rft 

irEfiKtcfcs^Mtt^a^ft^^fttt©*^^ 
R*ji** ltJ*&tt*ftBJRLTME>-f >^t»JR:* 
«U METW^Rtt. ME«R©a*tc*:*B*f*# 

T^^feoxaiftfiRKicfcsTWSfT^^t^ftafr 

So 

[0 0 14] RjftJSl 1 CE«©»Wi, R*«8CE 

«©»«afi^ittt5^T, MBx-^a&^awu w 

E*«Bx-^»ttSfi^6K*ffi$nfc^-^^S 
REfttRCTRRHSffl^TRII^-^^tJItai 

u isi7-y>^/h$vma$ it3Sfctt«»a 

[0 0 15] 2£E«©«9Jtt, 
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9 

H7 Jl/=fU XA£cfctfg^7 JUrf'J XAtCf^£i*£ 

^***a#iu, iWfB^>>^ufcimr3x-*ii 

[0 0 16] 3fcE*<&»91tt, »*JS1 2£ 

mE*a¥s^<fcD»^nfc«»(o<EK*ffl^T8aE* 

«©»««tcfcr)fl9E«*lja©1(f«**Ji3eL, 

^ucMt^ui^aiti,, »#jsi4k:e* 

<&«WfcL 11**1 2^E«©tt*5SS^iC»c*^T, 
HufBx-*jift¥gte, l»B*i¥Sf:cfct)»6niS:# ^ 
fiK^fflEPMx-^JcJSTS^ailR^iOHKiiLTft 

S= {(xl,yl) M .,(xi, ym)> 

TS. ±tt7;nf»JXAtt, KT©?I1^^?I3$ 

[0 0 19] (^)il) ^O^^EUfCttttSnfcx- 
SI,.., STfCfcfLT, Ttt*B7;i/zfUXA*^e-e:T 50 
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&«*^fc»LT^aStt**«)*WEiEK^a*© 
1 ^Sfttt*fta*LTlHIE*>r 

at-r*. mxmi sKEaasswi, m&mi 2 ice 

E*Sir-*IM!i8W^K*lliSftftT-*l:4* 

wt, **^tt, asaa^aias^ mE^naoa* 
ft # ^mmmomt ^mm&z i o& ^ Ljg&atR lt 

[0 0 17] 

[»w©*js<o^tt] ens z.<D%w<Dm*m% 

T4^en*Tffi*S7^rf'JXA«!:, £ft£m>T, 

ctt, x-^s^i^^x-^,^ (Rttacoa*) x 

XA^»)iao-jL»-7;i/*y h«7-^(D#S7;i/3fu 
(1) 

&RH1,,..HT£#*. ::"C, S= «xl.y 

l),..,(xm, ym)> U 1*>XU >^itt, WAtf 

x-^s*^— *»*ic«ko-y->^ij >??% (fip%, 

T\ Tfi7;HfUXAA*3feSl3:TfiHH*»S, 
[0 0 2 0] (?H2) R<0^H-9*>X;i/^xl,.., 

(ofit»tcj:o^<7)7^;i/co^ai|$$iiT, ^©TajficD 



(7) 
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[0 0 2 1] fc*3, ±lB(D>J^>7 P U>y<0^H$:jE* 

M(x)= E w, 

HI(x>Ytna* 



12 



/0 



[oo2 2] ±&<D^m*&K>mm\z«m°tz. t-9 
Axjzstr^-y>u (x) ttskTo&oizitmzft 

Hki] 



— max 



Y*Ymax E W l 
HI(jc)=Y 



(2) 



--T\ Hi (x) ttftKHi©?— ^jfltxKJtf-r^^ai 
ffl, wifcL fittHiJcft$nfca**»-r. *fc, yma 

yma X = arg max £ 

Y Hl(x)=Y 

£Ji5£2ft*. ft*, &fiK<z>a**»ALft^«£t;: 

*nTt>, v-^>o«AttftfiKoa**i tr^^ 

>«/hW^*«aa**©.«<i: UTS*??** - £**pHB 



[ft2] 

W, (3) 

[0 0 2 3] 3e£-r^$fltt%S^ftHfto«dic: 

S^tf£¥i$V (x) 14, *:£T^£n£o 
[*3] 



V(x)= E w«|H,(«)- H i(x)| (4) 

l=l,...,T 



CZX\ Hi (x) \Zrt~%msfzb<D\i.x<D7'<)lT 30 

[0024] j&u, &fiift©^sni©»ae^T-i;> 

M'(x)= E w,-max,* y . E 

Hi(x)=Y* HI(x)=Y 



t^tommmmm&<Dm&, (2) s<d 

»4] 

Wi (5) 



C^T> y *Hr-^ 
[0 0 2 5] £fc> « 

S¥*MIV' (x) t 



en, v (x) ttv 

RSS«fK&RSS<Diltt 



*£xK#T*^iHRiia)a*# 
V'(x)= E w,|H,(x)- 

M ' (x) J4M (x) CD£fg*CD 
(x) W£»*<&^«J¥^I&JE 

50 



[»5] 



(x) 



y*l 



(6) 



[0 0 2 6] Set, ±?B©±ffi7;i/=f>JXA»C*^ 
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m&w>s\z. ±$mm^-^> j p v ( X ) zmmL 

tit &ftc7)/h£&-r-* £NiJRrT£ C <hic J: 0 jl/S^n 

±BV # (x) *»HU V' (x) ®*Sft5*-*# 
[0 0 2 7] KT, HB*#BLTc:o58W©*|IS<D» 

bk^timhts. ant i^^is^ffiic^^a^ 

jLtt<n?n>fyj± 1 0 0©<Sj**^-rBn?»-6. 

LT*SStST-^SA*t SA*» 1 0 7<h, US 
«MBB10 3t, A*»10 7'\AA$nfc7^*» 

Mffil 0 2^jHLfc7^;Hl€:Hi*-r*ffl*BSl 0 1 

»IW« 1 0 6i3^6«*4ft*. 
[0 0 2 8] Hl©#«lC^^TKWr«. 
1 0 3tt, *a^>f >^^EU 1 2 OfclMflSttT^Sx 

K*SS¥l¥ai0 4i:, *S^» 1 0 4 ic «fc 0»6 
^Mgll3 0, *»*-f 1 2 0*<fctfCP 

u (4»*iR»J!iaKll) lion yn^^Aioo^ 

mi 0 3<z>*<7)(fl©ftfp«4Kwrso 10 
3it ^-o^u 1 2 0 \zfamztiTi^T-?frt> 

ttA«iT-^Mgf 1 3 0 fcftlfrra^H^ a 1 0 
4t, A§Ir-^MSIl 3 0<fc0tt*tti3ftfc« 

U 1 2 OKfcttTSx-^SRIMai 0 5j&>5&*. 

[0029] ±E««K:«ka»»56a*a:<oft^ 

A, MAtf, »«**Wr*7*:*yXAft£*A* 
81 0 7^A*-T* ttfy^S 2 0 1). Xf 
7^S 2 0 2T\ *i?Sl0 4H Cl^BfjftTatii/ 

-f >^ : eu 1 2 o^^^nri^x-^^^uitvy 

-*ll££A*!gBl 0 7^LTA^l, MBBTtt^B 
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2 0 3)o 

[0 0 3 0] *L 'Jlt>7 P U>^[Hl^i £#lt&fti: 

K i OT»£©0*Tfc*IAfc^i* Ur7^S20 
4 ; NO) , Xx^yS 2 0 2tcM0, ±I3^®S^jg 

fc Uf7^S 2 0 4 ; YES) . x-^aft^Rl 0 
5tt, «»Wk:»6nfcWBBfi»lftffl^T, A§ir- 

ys 2 0 5) . f-^Mfgl 0 5£cfcga*?£ftfc 

TfcSx-^KftlAS Uf7^S 2 0 6) 0 
[0 0 3 1] Xj7^S 2 0 7JC*5l>T, Xf- 

x» j *W*00ftN*jB*.fc<r>£* (Xr7yS2 0 
7 ; NO) , Xr^S 2 0 2 £ffi3I£»0 JET . X 
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